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Abstract: We discuss the validity of close-to-equilibrium entropy production 
principles in the context of linear electrical circuits. Both the minimum and the 
maximum entropy production principle are understood within dynamical fluctu- 
ation theory. The starting point are Langevin equations obtained by combining 
Kirchoff's laws with a Johnson-Nyquist noise at each dissipative element in the 
circuit. The main observation is that the fluctuation functional for time averages, 
that can be read off from the path-space action, is in first order around equilibrium 
given by an entropy production rate. 

That allows to understand beyond the schemes of irreversible thermodynamics (1) 
the validity of the least dissipation, the minimum entropy production, and the 
maximum entropy production principles close to equilibrium; (2) the role of the 
observables' parity under time-reversal and, in particular, the origin of Landauer's 
counterexample (1975) from the fact that the fluctuating observable there is odd un- 
der time-reversal; (3) the critical remark of Jaynes (1980) concerning the apparent 
inappropriateness of entropy production principles in temperature-inhomogeneous 
circuits. 



1. Introduction 

Fluctuation theory is a standard topic in equilibrium thermostatis- 
tics, and its relation to thermodynamic variational principles is very 
well understood. In nonequilibrium these studies stem from the funda- 
mental work of Onsager and Machlup, and its various generalizations 
are nowadays a hot topic, [H IH E]. The existence of a link between 
variational principles like that of least dissipation and the Onsager- 
Machlup Langrangians has been known for a long time. However, re- 
cent progress in better understanding the role of time-reversal symme- 
try and its breaking (cf. fluctuation theorems, Jarzynski identity etc., 
see e.g. Refs. jUEIH]) allows to analyze this in a fresh and more system- 
atic way, and to clean up some old ambiguities and to reinterpret some 
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of the existing formulations. That is the motivation of the present pa- 
per. 

A traditional way of illustrating how entropy production principles 
characterize the behavior of (non)equilibrium systems goes via the 
study of linear electrical circuits. The reason is that they provide 
physically clear and mathematically simple testing grounds for these 
hypotheses. The minimum and maximum entropy production princi- 
ples have a reputation of being vague or of being at best only sometimes 
valid. In fact a well known counter example was discussed by Landauer 
in 1975 showing that the minimum entropy production (MinEP) prin- 
ciple may not be satisfied even close to equilibrium, [TU1 [TTJ . A more 
general criticism was exposed by Jaynes, starting with the remark that 
the MinEP does not even work when in a network the resistors are kept 
at different temperatures, [8]. Surprisingly, it has not stopped people 
from applying MinEP in a variety of contexts and from inventing new 
proofs for it, see e.g. [TT] for a critical review. 

In the present paper we illustrate our new understanding of these 
principles via dynamical fluctuation theory. No longer is it solely a 
matter of verifying these entropy principles but of explaining their ori- 
gin and their approximate nature. More mathematical details are in 
[T6] . There are two particular steps in our analysis. First we con- 
nect the discussion with more recent work in nonequilibrium statistical 
mechanics, in particular as described in [HI [13] . We construct a La- 
grangian governing the distribution of system trajectories; the entropy 
production is identified with the source term of time-reversal breaking 
in that Lagrangian. Secondly, we explain how the entropy production 
principles can be derived from the fluctuation theory constructed from 
the Lagrangian. The basic input is the observation that the rate func- 
tion for certain stationary dynamical fluctuations is in a direct relation 
with the entropy production rate, when close to equilibrium and un- 
der specific conditions. This yields an extension of the classical work 
by Onsager and Machlup [18] which enables to systematically generate 
various variational characterizations of the stationary state. Among 
these we discuss the validity of both the MinEP and of its counterpart 
in the maximum entropy production principle (MaxEP). In particular 
we revisit Landauer's counter example and we show why the conditions 
for the validity of the MinEP are not verified. 

The plan of the paper is as follows. In the next section we introduce 
the general framework and formulate the main questions for which 
we give general answers. Afterwards we discuss some generic linear 
electrical circuits to illustrate the main points of the theory. 

The paper is part of a series of papers in which the entropy produc- 
tion principles are revisited and extended, also in the light of recent 
advances in nonequilibrium statistical mechanics, [TS1 HSl [2] ■ 
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The number of references on entropy production principles is enormous, 
mostly however within the formalism of irreversible thermodynamics. 
We mention some but only a tiny fraction of them in the course of the 
paper. As is well known, much of the pioneering work was of course 
done by Ilya Prigogine, see Refs. [HIE]. As a discussion of some con- 
ceptual points, we mention Refs. [51 [12] . 



2. Set-up and general strategy 

In the present paper we explain when entropy production principles 
can be expected to yield correct physical information. That will be 
illustrated in the context of linear electrical circuits. Given such a net- 
work there is often an immediate phenomenological expression of the 
entropy production rate S(X, X) as a function of the relevant vari- 
ables X = (X a ) (potentials, currents), their time-derivatives X, and 
in terms of the network parameters (values of the electrical elements) . 
From S(X,X) we can still construct other entropy production vari- 
ables, e.g. by substituting a dynamical law for X one obtains a typical 
entropy production rate at state X. The question is now when and why 
the correct physical values for the potentials and/or the currents mini- 
mize or perhaps maximize these entropy production rates, in whatever 
form. The question and part of the answer will become more clear be- 
low. We will then give examples of networks, write down the relevant 
entropy production and show how it can serve, if at all, as a variational 
functional. 

Our treatment of electrical circuits relies on the use of Kirchoff equa- 
tions that themselves assume a quasi-stationary regime of the Maxwell 
equations, thus forgetting about the dynamics of the electromagnetic 
field. The resulting differential equations are well known and their sta- 
tionary solutions are in the standard textbooks. Obviously our goal 
is not to study linear electrical networks; in the present paper we use 
them merely as an example to illustrate why and how nonequilibrium 
behavior can or cannot be obtained from variational principles for the 
entropy production. We refer to e.g. [7] for other and further illus- 
trations of the use of electrical networks in studies of nonequilibrium 
physics, also using stochastic methods. 

For that purpose, Kirchoff 's differential equations will be embedded 
in stochastic equations whose averaged behavior reproduces the de- 
terministic equation. Not only does that enable the use of stochastic 
methods but there is also a good physical reason to include extra noise. 
In accord with the fluctuation-dissipation theorem, the thermal agita- 
tions in a resistor are related to the distribution of the random electric 
field acting upon the electrons. As a consequence, a random voltage 
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emerges and can be measured at the ends of the resistor (Johnson ef- 
fect). That voltage can be described as a random process Jj[ given by 
the Nyquist formula: 



Utdt=* dW t , or Ut=J=£ & (2.1 





with R the resistance, Wt a standard Wiener process and more for- 
mally, £t a standard white noise; the prefactor is of course very small 
by the presence of Boltzmann's constant in f3~ l = ksT, at least when 
compared to macroscopic voltage values. Hence, every 'real' resistor 
can be equivalently represented as an ideal resistor in series with the 
random voltage source U{ . Using such a representation for all resis- 
tors present, we can study fluctuations in an arbitrary electrical circuit. 
The resistors in the network are the only source of fluctuations and of 
steady dissipation. Apart from the transient contributions coming from 
capacitances or inductances, each resistor R through which a current / 
flows and which is kept in thermal contact with a reservoir at temper- 
ature contributes a steady term [3RI 2 to the entropy production. 
Having thus determined the entropy production rate S(X, X) for the 
electrical circuit, we must understand how it gives rise to a variational 
principle for the variables in the network. 

The following can be skipped at first reading and one can choose to go 
directly to the examples in Section [3J 

The line of reasoning will be as follows. For a given electrical circuit 
we write down (first law) the conservation of charge, that the sum of 
all currents equals zero at every node, and (second law) the conserva- 
tion of energy, that the sum of all potential(differences) over any loop 
equals zero. In those we take care to add with every resistor the ran- 
dom process U{ for an additional fluctuating potential difference. The 
basic variables are then the potentials and the currents satisfying linear 
stochastic differential equations of the generic form 

X a (t) = f a + ^c Q , 7 X 7 (t) + \P^Ut) (2-2) 
7 » Va 

where the £ a (£) are mutually independent standard white noises; the 
X a represent the fluctuating variables (currents and potentials that can 
be chosen freely); the constants determined from Kirchoff 's 

laws and from the Nyquist formula ( 12. ID and the f a is the external 
"force" (such as from an external source or battery). We will see equa- 
tion (J22} specified in <K2§ . (|3~8l) . (13361) . and fl3T2% 
That stochastic dynamics induces a probability distribution P on his- 
tories u>, where for each time t, u t = (X a (t)) a states the values of the 
potentials and of the currents. The action in P is readily computed 
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from Ito-stochastic analysis: 

P(uj) oc exp 



dt£(u t ,u t ) 



with Onsager-Machlup Lagrangian, formally, 

C(X,X) = - f a - ^c a , 7 X 7 ) 2 (2.3) 

a 7 

From a mathematical point of view, such expressions are justified within 
the Freidlin-Wentzell theory of stochastic perturbations of determinis- 
tic evolutions [3]. Observe that v a = 0(/3) in the electrical circuits and 
v a is a very high frequency for not too high temperatures; therefore 
the typical trajectories are X a = f a + J2 7 c a,-yX^ and (3' 1 can be taken 
as a perturbation parameter in the theory. 

Each time in the examples below, we will explicitly write down that 
Lagrangian, see (El), (13371) . and (13T25D . 

When applying the general model (12.21) to a particular physical prob- 
lem, we always have to satisfy a consistency condition: that the an- 
tisymmetric term under time-reversal in C is the physically correct 
entropy production S(X, X), usually a priori known from the context. 
It means the entropy production must satisfy 

C(eX, -eX) - C(X, X) = S(X, X) (2.4) 

with (eX) a = e a X a for parities e a = ±1, labelling the (anti) symmetry 
under kinematical time- reversal. E.g., e a = 1 (or — 1) if X a is a volt- 
age (or current). In our linear electrical circuits, that is ensured by 
satisfying the fluctuation-dissipation relation by taking (12.11) as noise 
terms, in combination with a suitable choice of variables or of the level 
of description. The latter point is subtle: using a too coarse grained 
level of description one can easily 'become blind' to some contributions 
to the total entropy production. Relation (}2.4j) will be checked in each 
example below, see (JXTD, (1533]) . <KWi . and (CT2511 . 
When there is no driving (no external force nor battery nor differences 
in temperature,...) the dynamics certainly reduces to that of an equi- 
librium system in which case the entropy production rate (12. 4ft must 
be a total time derivative: 

" 1 dt S(X(t),X(t)) = (3 [ H(X(ti)) - H(X(t )) ] (2.5) 

to 

for some energy function H(X) and some inverse temperature j3. The 
equation (12. 5p formulates the condition of detailed balance. 

2.1. Transient entropy production principles. For the purpose of 
obtaining variational principles, we must look back at the Lagrangian 
(12. 3p . We can for example fix a history (X a (s)) for times s < t before 
some fixed t and ask what is the most probable immediate future. 
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Clearly, it amounts to finding the (X a (t)) that minimize C(X (t) , X (t)) , 
i.e., to minimize 

V 1 (X, •*) = j $>« K - 2X « (/« + E c «^)] (2-6) 

a 7 

That is traditionally called the least dissipation principle because when 
all variables are even, e a = 1, it is easily checked that 

2V 1 (X,X) = \Y, V «X 2 « ~ ( 2 - 7 ) 

a 

which can be traced back to mechanical and equilibrium analogues 
given by Rayleigh and Onsager, see [18]; the expression 

V{X) = Y,v*Xl (2.8) 

a 

is sometimes called the dissipation function. The typical behavior 
X(% = f a + ^ 7 c Qj7 X 7 as expected from (12.21) . can thus be charac- 
terized as the one minimizing (12. 7\\ (still under the condition that all 
e a — 1). We can rewrite that as a (transient) maximum entropy pro- 
duction principle (discussed in e.g. Ref. [20] )■ Indeed, minimizing 
(12. 7p over the X (for given X) is equivalent with maximizing S(X, X) 
under the additional constraint that T>(X) = S(X,X). 

Alternatively, we can fix the X a 's in (12.31) and we collect the free 
variable part of (12.31) in what we call V 2 ; we must then find the X a 's 
minimizing 

a 7 

-2(X a -f a )J2^X,} (2.9) 

7 

The solution will give us the typical X a 's. When now all the variables 
are odd, e a = —1, that reduces to minimizing 

2V 2 (X,X) = \j2 v «CE c ^ X -f) 2 - S(X,X) (2.10) 

a 7 

With the definition of typical (or expected) entropy production 

a(X) = S(X, X = f + J2 c, 7 X i) (2- 11 ) 

7 

the expression (I2.10p can be rewritten as 

2V 2 (X, X) = ~a(X) - S(X, X) (2.12) 
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which we have to minimize over the X Q 's or, alternatively, S(X, X) has 
to be maximized under the constraint S(X,X) = cr(X). 

Remark that if either a) all variables are even and driving forces 
arbitrary, or b) all variables are odd and the forces absent, f a = 0, 
then both the variational principles T>(X)/2 — S(-, X) = min (12. 7p and 
a(X)/2 — S(X, ■) = min (12.121) are valid and in a sense dual. The reason 
is that they are both corresponding to a relaxation to equilibrium with 
Lagrangian taking the symmetric form 

2C{X,X) = ±V(X) - S(X,X) + la(X) (2.13) 

a scenario originally considered by Onsager and Machlup [TS]. How- 
ever, that structure needs a modification when a true nonequilibrium 
driving is present and/or when even and odd variables mix with each 
other. (There was already an example above when all variables were 
odd and a driving force was switched on.) 

In applications, most interesting is the stationary regime for which 
X = 0. We discuss that at large in the next section. 



2.2. Stationary entropy production principles. For the station- 
ary regime, we obtain a variational functional by simply putting X a = 
in the Lagrangian (12. 3p to get 

J W = JZ>«(/° + E c ^) 2 (2-14) 

A more fundamental point is that J is the large deviation rate function 
for empirical averages / X(t) dx/T when T ] oo, i.e., 

1 f T 1 

- / X{t)dt = x ~exp[-TJ(x)} (2.15) 
T Jo J 

The mathematical theory of such large deviations was initiated by 
Donsker and Varadhan, see (5j [3]. Equation C I2. 151) resembles Ein- 
stein's formula for equilibrium fluctuations from which various vari- 
ational characterizations of equilibrium follow, in terms of entropy and 
related potentials, see also Ref. [T3]. Our line of thinking is similar 
here: a systematic way to obtain meaningful nonequilibrium varia- 
tional principles is to consider dynamical large deviations. That point 
of view gets of course more interesting when the stationary state is less 
explicit, like for mesoscopic systems or for more general Markov pro- 
cesses [H] far from equilibrium, possibly with time-dependent driving 
etc. 



8 



2.2.1. Even variables. When all fluctuating variables are even under 
time-reversal (all e = +1), then it is easy to verify that 

J(X) = ~a(X) (2.16) 

see e.g. (12.13!) . Thus, in that case, we get the typical (equilibrium) 
values for the X by minimizing the entropy production cr(X), which 
becomes zero in equilibrium. The most basic example is in Section 13.11 

2.2.2. Odd variables. Including variables that are odd under time-reversal 
is necessary in order to obtain a truly nonequilibrium stationary state 
in the present framework. We first investigate what happens when we 
have only odd variables. 

The basic idea is always that we must minimize J{X) but now it dif- 
fers from the physical entropy production. That is in accord with a 
general observation that for odd variables the minimum entropy pro- 
duction principle does not apply. Instead, minimizing J(X) can now 
be understood as a certain maximum entropy production principle. 
The reason is that for odd variables 

2J(X) = \a{X) - S(X, 0) + i £ v a fl (2.17) 

a 

Hence, we need to minimize 

\a{X) - S{X,ti) (2.18) 

In the stationary case, we have o~(X) = S(X, 0). Thence, minimiz- 
ing J(X) amounts to maximizing the entropy production cr(X) under 
the constraint that c(X) = S(X, 0). That repeats the discussion af- 
ter (I2.12p . but this time for the stationary case X = 0. 
The required modification of the MinEP (to minimizing (I2.18P ) when 
dealing with odd variables is also how Landauer's counter example [TUJ 
ITTj should be understood. The details are in Section 13.21 

2.2.3. Even and odd. The above equations (12.161 12.171) have been ob- 
tained for dynamical variables that are either all even or all odd un- 
der time-reversal. We can make that more general. Suppose our La- 
grangian includes both time- reversal even and odd variables: {X a } = 
{Xf, X~}, where it is understood that the Xf are even and that the 
X^ are odd under time- reversal. The Lagrangian (12. 3ft now takes the 
form (in obvious notation): 



»+ 3+ j- 

*- 3+ 3- 



(2.19) 



Remember that from the beginning we restrict ourselves to external 
driving forces which are even under time- reversal; for odd driving forces 
already (12.41) needs a modification but an analogous reasoning applies. 

Let us first consider the entropy production rates. After some cal- 
culation, we find for the expected entropy production (12. lip : 

,2 



a(X\X-)=J2vt(ft + J2 c tr X t) 

i+ 3+ 



(2.20) 



From this we can further construct a function of the even and a func- 
tion of the odd variables. We thus get two additional, even and odd, 
expected entropy production rates a + (X + ) and a~(X~) given as 

a+(X+) = a(X + ,X-(X + )) 

(2 21) 

a-(X-) = a(X+(X~),X-) 1 ' ' 

where for the first (even) case we insert X~ = X~(X + ) from solving 
the stationary condition 



3 + 



and likewise, for the second (odd) case we substitute X + = X + (X ) 
as found from 

3+ 3- 

That will be explicitly visible and done in ( 13.22D . 

The large deviation rate function (12.141) can also be calculated: 

aj (x + , x-) = 4 [{ft + Yl 4 + x+) 2 + (J2 4fxjf 

i+ j+ j- 

+ 2(^ + E4 + ^)(E c r^)] 

3+ 3~ 

+ E«r[(/r+E% +x /) 2 + (E%" x 7) 2 

*- 3+ 3~ 

+ 2(/f + £.cr.+x;)£> ir xr)] 

3+ 3- 

To simplify the structure, we make here the (nontrivial) assumption 
that the even and the odd variables do not mix in J . Hence, we 
require that 

J(X+,X~) = J + (X + ) + J-{X-) (2.22) 



10 



(i.e., the cross terms are zero), with 

%+ j+ (2 23) 

+ E^ur + E% + *;) 2 

i- j+ 

and analogously for J~(X~), see below in (12.251) . That decoupling of 
the even from the odd variables in the rate function J , implies the 
relation 

4.7 + (X + ) = a + (X + ) (2.24) 
which is a generalization of (I2.16p . 

Remember now that we must minimize J (here of the form (I2.22p ) 
to obtain the typical stationary values. Hence, if indeed the time- 
symmetric and time-antisymmetric variables in J decouple, then (I2.24p 
tells that we should minimize the expected entropy production a + . We 
will see an example below in Section 13.31 

There is also a MaxEP principle in the above setting. Write J~ as 

4 J- = E < (E <T X ;Y + E «- r (E % x rf 

i+ j- i- j- 

+ 2 E <lt E <T*r + 2 V V C ~ X - (2.25) 

*+ j- i- j- 

= a-(X-)-2P(f,X-) 

where V can be interpreted as the power input from the external forces 
/. Suppose we take the constraint o~ = V meaning that the delivered 
work is completely dissipated and there is no accumulation of internal 
energy (true indeed in the stationary state when X = 0). Minimizing 
J~(X~) under the constraint <r~ = V is equivalent to maximizing a~ 
under the same constraint. That MaxEP principle was used similarly 
in Ref. [21]. 

3. Examples 

We demonstrate the above general theory on a few simple examples 
of linear circuits. In particular we will see that close to equilibrium 
the rate function J can indeed be split in the even and odd parts, 
and hence, depending on the choice of variables, we obtain MinEP or 
MaxEP principle. 

3.1. RC in series. Consider a resistance R in series with a capacity 
C and with a steady voltage source E. Write U — U t for the variable 
potential difference over the capacitor. Kirchhoff's second law reads 

RCU = E -U + U f (3.1) 
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By inserting the white noise £ 4 following (12.11) . we are to study the 
Langevin equation 



^ = £ R^ + te ? ' <3 ' 2) 
There is no other free variable apart from U; in particular, the current 
/ = CU . A standard reasoning proves the consistency of this model: 
with the battery removed, E — 0, the dynamics is reversible with 
respect to the Gibbs distribution at inverse temperature (3 and with 
energy function H{U) = CU 2 /2. In particular, lim tToo (f/ J ?) = 
in accordance with the equipartition theorem. 

Heuristically, the entropy production rate c{U) as a function of the 
voltage U on the capacitor is simply the Joule heating in the resistor 
R: 

a{U) = P {E ~ R U)2 (3.3) 

Apparently, its minimizer U* = E coincides with the correct value for 
the stationary voltage, verifying the MinEP principle. 
We can understand that within our general framework. The Onsager- 
Machlup Lagrangian C(U, U) of the process U t is 

From C we can derive the fluctuations of the empirical voltage Ut = 
Jq U t dt /T. The stationary (T f +oo) fluctuations of Ut are given by 

(jraD-(ra): 

P[U T ^u]oc exp[-TJ(u)} (3.5) 

with rate function 

J(U)=C(U,0) = \a(U) (3.6) 

The fluctuation law ( 13. 5ft thus gives a variational principle for the sta- 
tionary voltage just coinciding with the MinEP principle: the most 
probable value for the time-averaged voltage is obtained by minimiz- 
ing J(U) = a{U)/A. 

In fact, this is just a particular example of the relation (12.161) . To 
see that we still have to check that our model is consistent with rela- 
tion (EEljl . Indeed, 

S(U, U) = C(U, -U) - C(U, U) = (3CU(E - U) (3.7) 

is the physical entropy production rate, and its typical value (12. lip 
equals 

S(U,U=^£)=*(U) 

verifying ( 13. 3p above. Hence, from the fluctuation point of view, the 
manifest validity of the MinEP principle for this RC-circuit is nothing 
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but a consequence of the invariance of the voltage (or charge) with 
respect to time-reversal. 

3.2. RL in series. If the capacity in the previous section is replaced 
with an inductance L, the situation remarkably changes. In that case, 
Kirchhoff's second law for the current I becomes 

RI-U f + L^- = E 
at 

(where the minus sign is chosen for convenience only), or, inserting the 
white noise £ t from (12.1 1) . 



(3.8) 

That is again a linear Langevin equation, but now the fluctuations con- 
cern the current It which is odd under time-reversal. 

We can try to repeat the same as in the previous section. The La- 
grangian now equals 

The construction of the fluctuation rate for the empirical current 
J Q T I t dt /T can again be done following fl2.14p - fl2.15l) with the result 

J(I)=C(lJ = 0) = ^[l-^) 2 (3.10) 

As generally true, the minimum of J over / is given by the correct 
stationary value. However, that J clearly differs from the physical 
entropy production the expected rate of which is now 

a{I) = [3RI 2 (3.11) 

So while we can find the most probable current /* = E/R by mini- 
mizing J (I), it does not correspond to a minimization of the entropy 
production. Indeed, our RL-circuit is the classical example first given 
by Landauer through which we see that the MinEP principle is not 
generally valid and 'not reliable' when applied to macroscopic systems, 
even in the linear irreversible regime. We can now however understand 
what is the real cause of that effect. 

Similarly to fl3.6l) -f j3~71) . the variational functional J{T) of (I3.10p for 

the stationary current satisfies 

J{I) = ~ [C(I, -/) - C(I, /)] \ t=s ^u (3.12) 
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but £(/, —I)—C(I, I) does not longer coincide with the variable entropy 
production S. Since the current is odd under time reversal, the latter 
is rather, see (12.41) . 

S(I, I) = £(-/, /) - £(J, /) = I3I(E - LI) (3.13) 

in accordance with the phenomenology; note that the equilibrium dy- 
namics (i.e. (13.81) with E = 0) satisfies detailed balance with energy 
function H{I) = LI 2 /2. 

Via our fluctuation approach we thus understand the origin of the 
problem: the MinEP principle is generally valid only for Markovian 
dynamical systems described via a collection of observables that are 
symmetric under time-reversal. The Markovian property refers to the 
first order (in time) of the dynamical equation and indicates that the 
variable in question thus satisfies an autonomous equation. 
Observe that we now see appear the 'true' variational principle for 
the stationary current as was explained under (12. 1 7D - (12. 18D : for odd 
observables the above argument proposes a different functional that 
replaces the entropy production a(I) and that can here be chosen as 

- S(1, 0) 

as follows from (13.101) written in the form 

As the stationary value I* satisfies cr(J*) = S(I*,0), we can also 
state the above variational principle as a maximum entropy produc- 
tion principle: we must maximize a(I) subject to the condition that 
5(1,0) = <7(I). 

3.3. RR in series. Consider an electrical circuit consisting of a bat- 
tery E coupled to resistors in series. Appending an independent Nyquist 
random voltage source U[ to all resistances Rk, we get that the current 
/ fluctuates according to 

lJ2Rk = E + J2u[ (3.14) 

k k 

Here, the current follows a singular Markov process of the form of a 
white noise. We can however modify that singular dynamics so that it 
becomes a regular Markov process and so that the (averaged) stationary 
current remains unchanged. An important addition to the discussion is 
to see the effect of assigning different temperatures f3k to the individual 
resistors, as it was claimed that such an extension would again yield a 
counter example to the MinEP, [8]. 

For regularization we choose to add an inductance in series with the re- 
sistors so that a non-trivial transient regime can arise. However, adding 
only an inductance gives a too coarse grained description, because as 



14 




c 

Figure 1. The regularized RR-circuit. 



one can check, then (12 .4p would not be satisfied with the correct ex- 
pression for the entropy production. That can be solved by adding a 
capacitance in parallel with one of the resistors, see Fig. [TJ We thus 
have an effective RLC-circuit with two resistors in series and one ex- 
ternal voltage. The two independent free variables are the potential 
U over the first resistor and the current I through the second resistor. 
The variational functional (12.141) or the expected entropy production 
(12. lip will not depend on the auxiliary inductance L or on the capaci- 
tance C. 

The dynamical equations are given by Kirchoff 's laws: 



C R\C R\C ^ 



E-Rzl-U U 2 



L 



where always from (12. II) . U{ 2 dt = J 1R\p,ft\^ dWt- The equilibrium 
dynamics (E — 0, /?i = /3 2 = /3 in (13 . 15j) ) can be written as 



■ 1 dH OH /2 7 i 



1 OH OH /2 72 . 



LCdU ' dl V P 



(3.16) 



for energy function H(U,I) = (CU 2 + LI 2 )/2 and friction coefficients 
7i = l/(RiC 2 ), 72 = R2/L 2 ; the ^1 and ^2 are independent standard 
white noises. The first terms on the right hand-side of ( 13.161) specify a 
Hamiltonian dynamics for the pair (U,I), while the other terms balance 
the dissipation and the random forcing. 
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The (nonequilibrium) Lagrangian is obtained from f 1 3 . X 5 j) as 

U n2 



£([/,/; U,I) 



P1R1C 2 ( • I 
4 V C 



AR 2 



R X C, 
E-U\ 2 



L 



(3.17) 



(3.18) 



and the variable entropy production (12 .4p is 

s(u, i- ii, i) = c(u, -i- -ii, i) - c(u, i- u, i) 

= PtU(I - CU) + /3 2 I(E -U -LI) 

as it should. One recognizes indeed the dissipation in each resistor; 
/ — CU is the current through resistor 1 and E — U — LI is the voltage 
at resistor 2. Thus, the expected entropy production (12.111) is 



a(U,I) = f3 1 ^- + (3 2 R 2 I 2 
Hi 



(3.19) 



On the other hand, the true variational functional fl2.14p - ()2.15p is di- 
rectly obtained from (13.171) : 

(E - Uf 

R 2 (3.20) 



4J(U, I) = a(U, I) + ^RJ 2 + (3 2 - 



-2[/3 1 UI + (3 2 (E-U)I] 

and differs from the entropy production because we have both an even 
(the potential U) and an odd (the current I) degree of freedom; com- 
pare with (I2.16P and (12.171) valid in the case of only even respectively 
only odd variables. So now we have to go to the formalism with mixed 
variables as in (I2.19p - (l2.25p . Although J does not exactly split into 
even and odd parts as in (12.221) . it does approximately close to equilib- 
rium: if (3 — (3\ — /3 2 + e, we have 



4J(U,I) = P 



U 2 (E - Uf 



+ 



+ p(R ± + R 2 )I 2 



(3.21) 



-Ri R 2 
- 2f3EI + 0(e) 

which is of the form (I2.22p . Since the even and the odd versions (I2.2ip 
of the entropy production rate are 



rtl rC 2 



U 2 | {E-Uf 
Ri R 2 



0(e) (3.22) 



and 



a~ {I) = f3 1 R l I 2 + (3 2 R 2 I 2 = P{Rt + R 2 )I 2 + 0(e) (3.23) 

the minimization of J provides us with the next two variational prin- 
ciples: 

First, the stationary voltage U* is obtained from minimizing J + (U) = 
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a + (£/)/4, which is a (generalized) MinEP principle (12.241) . 
Second, minimizing J~{T) = c~(-0 — 2/3 EI or, equivalently, maximiz- 
ing a~ under the constraint (T~(I) = (3EI yields the stationary current 
/*; this is an example on the MaxEP principle (12.251) . 

An important remark is that the above derivation of the MinEP and 
the MaxEP principles was based not only on the assumption that the 
temperature is approximately homogenous but also on the linearity of 
the stochastic model(s) under consideration. They should be really 
taken as a (linear) approximation around detailed balance. In partic- 
ular, also the current / and the forces U and E should be considered 
of order 0(e), together with the assumed /3 2 = (3\ + 0(e). The above 
then means that the MinEP and MaxEP principles are only valid up to 
order 0(e 2 ), i.e. within the linear irreversible regime; see [16J for some 
more details. 

In view of this remark we understand better why these principles do not 
carry over to temperature-inhomogeneous circuits: in our simple cir- 
cuits the temperature gradients are redundant thermodynamic forces in 
the sense that they do not generate electric currents by themselves; they 
only modify the dynamics of fluctuations. Hence, these gradients yield 
corrections of order o(e 2 ), beyond the resolution of the MinEP/MaxEP 
principles. This solves the remarks by Jaynes [E]. Apparently, the pic- 
ture would get completely changed by adding e.g. a thermocouple into 
the network. 



3.4. RR in parallel. For the sake of completeness, we finally consider 
two resistors in parallel and coupled with an external voltage source 
E. The independent variables are the currents 1\ and I 2 through the 
two resistors. To have a dynamics consistent with our condition ( 12 Ah 
we again need a regularization and for that we add two inductances in 
series with the resistances. The resulting stochastic dynamics is 

Lih = E — R x h + U{ 

f 3.24 
L 2 I 2 = E — R 2 I 2 + U£ 

The Lagrangian, the entropy production rate, its expectation, and the 
stationary variational functional are subsequently as follows: 

AC = ^-(Lxh + Rth ~ Ef + ^-(L 2 I 2 + R 2 I 2 - E) 2 
Hi K 2 

S(h, I 2 ; h; j 2 ) = p x h{E - Lih) + fah(E - L 2 I 2 ) 
a(I u I 2 )=f3iRiI 2 1 +(3 2 R 2 I 2 2 

AJ(h, I 2 ) = a(I u I 2 ) - 2S(h, I 2 , 0, 0) + + pJL 

tii ti 2 



(3.25) 
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If (3i = 02 + e, minimizing the rate function J results in minimizing 
a(Ii,I 2 ) — 2f3E(Ii + J 2 ) up to order e. Note that this splits into two 
independent variational problems for I\ respectively J 2 which comes as 
no surprise: the two currents are entirely dynamically decoupled. Yet, 
one can again formulate a single MaxEP principle in this case: the 
stationary currents are obtained by maximizing the expected entropy 
production rate a under the constraint cr(/i, J 2 ) = (3E(Ii + I 2 ), the 
right hand side being just the total power input. This formulation is 
equivalent with the MaxEP principle in [21]. Analogous remarks as in 
Section 13.21 apply here. 

4. Conclusions 

Fluctuation theory naturally identifies the specific structure of dy- 
namical fluctuations as the underlying reason for the (variational) en- 
tropy production principles as well as their validity conditions and lim- 
itations; just as the equilibrium fluctuation theory explains the maxi- 
mum entropy principle and its derivations. It also provides a natural 
and systematic way how to search for new variational principles beyond 
trial-and-error methods, not available within pure thermodynamics. 

We summarize our findings within that more general perspective: 

• Both MinEP and MaxEP principles have various forms (for hy- 
drodynamic models in local equilibrium, for discrete networks, 
for various types of Markov processes,...), but there is no es- 
sential difference between them up to the crucial restriction to 
the close-to-equilibrium regime. All attempts for their exact 
justification beyond the linear regime are highly doubtful. In 
particular, thermodynamics itself has little to say here about 
possible generalizations except via some trial-and-error meth- 
ods. We expect that dynamical fluctuation theory will present a 
more systematic avenue for evaluating nonequilibrium behavior 
via variational methods. 

• There is no fundamental difference between the nature and va- 
lidity of the MinEP and the MaxEP principles. Which one is 
to be used depends on the choice of thermodynamic variables, 
whether they are symmetric or antisymmetric with respect to 
time-reversal. That clear observation is a first concrete result 
that the fluctuation/statistical approach provides. 

• The set-up in the pioneering works of Prigogine [19] concern- 
ing MinEP typically refers to some canonical thermodynamic 
structure. Yet, it is useful to broaden the view on these vari- 
ational principles; the MinEP principle is valid for mesoscopic 
systems (Markovian, both with discrete and with continuous 
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state space) where one does not a priori recognize some canon- 
ical structure as is usually written in terms of forces and cur- 
rents. 
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